Systems and method for identifying modified program data

ABSTRACT

The technology described implements attestation programs that employ “code reuse” techniques. In particular, the technology relates to auto-generating attestation programs for, among other aspects, detecting whether a program has been modified. In one non-limiting example, the technology uses a tool that scans a software program (e.g., a video game) code for usable code sequences. The tool can automatically combine code sequences to generate a large number of attestation programs of different variety (e.g., memory checks, hashing).

CROSS REFERENCE TO RELATED APPLICATION(S)

This application is a continuation of U.S. patent application Ser. No.17/026,482 filed Sep. 21, 2020, the entire contents of which areincorporated herein by reference.

TECHNICAL OVERVIEW

Video game systems have enabled players to participate in variousdifferent gaming environments for decades. Games are designed in amanner so that the players are presented with a finite set ofparameters, boundaries, and rules in which to play the game. Forexample, a video game may allow a player to “level up” to a certainamount, or the player may be “restricted” from certain movement in thegame environment (e.g., walking through walls). Certain players maymodify the game program and/or game metadata in a manner that was notintended by the original designer(s) of the game. For example, theplayer may modify the software so that the game character can level upfaster or walk through walls in the game. Thus, certain drawbacks existwhen designing a video game environment in a manner that reduces orrestricts modification in this manner

COPYRIGHT NOTICE

A portion of the disclosure of this patent document contains materialwhich is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentor the patent disclosure, as it appears in the Patent and TrademarkOffice patent file or records, but otherwise reserves all copyrightswhatsoever.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a block diagram of a non-limiting example system;

FIGS. 2A and 2B show non-limiting example user interfaces generatedand/or displayed by client devices associated with the system;

FIG. 3 shows a non-limiting example block diagram of internal componentscomprising a server system;

FIG. 4 shows a non-limiting example block diagram of generating anexample attestation program;

FIG. 5 shows a non-limiting example block diagram of a database of thesystem;

FIGS. 6A and 6B show non-limiting example flowcharts for processescarried out by the system; and

FIG. 7 shows a non-limiting example block diagram of hardware componentscomprising the system.

DETAILED DESCRIPTION OF EXAMPLE NON-LIMITING EMBODIMENTS OF THETECHNOLOGY

Software programs are capable of restricting users from performingcertain actions (or accessing certain features) for various reasons. Forexample, business software products (e.g., word processing applications)may restrict users from certain functionality (e.g., printing or editinga document) until the user has agreed to purchase such features.Likewise, video game technology may restrict users from both unlockingcertain features (or DLC) as well as prevent users from performingvarious actions in the gaming environment (i.e., “cheating”).

Cheating in video games has been prevalent almost since the dawn ofgaming Decades ago, users could press specific buttons in a specificorder in certain games to unlock features, such as the amount of player“lives.” Video game cheating has evolved greatly over the years to apoint where users can modify the software and/or metadata to gain anunfair advantage.

Such cheating is egregiously prevalent where the gaming environment isextended to multiplayer gaming (particularly multiplayer gaming over theinternet). In particular, users are able to modify software in a waythat enables them to have advantages over other players on differentsystems across a multiplayer game. These unfair advantages result in thegame being much less satisfying to the user thereby affecting theoverall human-user experience and interaction in the game. Moreover,such modifications to the game program create certain security risks forthe game system.

Certain conventional technology exists for detecting when a user mayhave modified their particular software program. For example, aconventional attestation architecture exists for using attestationprograms to detect whether software has been modified. The systememploys a client-server architecture where an attestation program isselected from the server and transmitted to the client device. Theclient can execute the attestation program and reply to the server withan attestation result. The server can compare the result to an expectedresult and, if a mismatch is detected, the client is flagged as“compromised.” The system administrator(s) could determine what type ofaction to take against the “compromised” client (e.g., banning the user,sending a warning, no action).

As a more specific non-limiting example, the server may detect a“mismatch” in the data using a hashing technique. It should beappreciated that certain program data may run the attestation program togenerate a hash result which will produce a known (e.g., fixed-length)value as output. The hash result can be obtained by the server andverified against the known value to determine if a “mismatch” occurs. Ifthe result generates a “mismatch,” the server will then identify theprogram as being modified and thus the client system will be marked as“compromised.”

The conventional approach is advantageous because it allows the gamesystem to determine if different users have modified the software sothat the system administrator(s) can take appropriate action. However,the conventional approach has certain drawbacks. As an example, underthe conventional approach, a user could compromise the hash function inthe game (or attestation logic) and then a developer will be required tocreate and deploy a patch to all client devices running the gameprogram. Moreover, the conventional approach requires cooperation fromthe client-side devices for executing the attestation logic at theclient and thus true detection of “cheating” cannot be done “remotely”on the server-side (or remote-side) system.

The technology described herein thus improves upon the conventionalapproach, in part, by using attestation programs that employ “codereuse” techniques. As a non-limiting example, certain return-orientedprogramming (“ROP”) or jump-oriented programming (“JOP”) techniques canbe used by “attackers” to bypass security defenses by selecting specificsequences of instructions already present in system memory and executethe instructions out of the intended order to achieve a functionalitythat may not have been originally present in the software.

The technology described herein can use ROP/JOP techniques forautomatically building attestation programs from code sequences alreadypresent in the game. As an example, there may be thousands of usablecode sequences in a typical game. By themselves, these sequences are notnecessarily related to a particular attestation program/approach. But,these code sequences can be chained together in a combination to performa new function (e.g., memory check, hashing operation).

Attestation results computed by each attestation program is dependent onthe used code sequences. Since there are thousands of usable codesequences in a typical game, results cannot be easily predicted andfaked. The logic described herein does not necessarily need to rely onany secrets (e.g., keys, algorithms) and can work even when the systemis completely compromised.

The technology thus can rely on a large number of possible combinationsthat each potentially generate a different result. It should beappreciated that the complexity of the attestation logic can be scaledup in response to certain conditions (e.g., by using different codesequences, or more code sequences chained together). Updating the logicin this manner advantageously does not require releasing a patch for asoftware program.

The technology described herein thus relates to auto-generatingattestation programs for, among other aspects, detecting whether aprogram has been modified. In one non-limiting example, the technologyuses a tool that scans a software program (e.g., video game) code forusable code sequences. The tool can automatically combine code sequencesto generate a large number of attestation programs of different variety(e.g., memory checks, hashing).

Each selected code sequence in the attestation logic may perform aspecific operation (e.g., load from memory, a math operation, a call toa hash function). A final attestation result may depend on both a valueat a test location in the software memory and the operation performed byeach code sequence. For example, a code sequence N may usemultiplication by a constant, or an addition with a constant, totransform a value read from memory. Each program can generate a unique“good” result where a server may maintain database(s) of expected “good”results per the attestation program. An “attestation check” can beperformed by the server based on a program running on a particularclient to determine if the client may have modified the program.

In order to fake a result of attestation, an attacker has to analyze theprogram, extract code sequences and the code sequences associated order,and analyze what each code sequence does. As there are normally a largenumber of usable code sequences in a typical software program, doing soin real time would be very difficult. Thus, the technology describedherein advantageously allows the system to generate and store amultitude of attestation programs allowing the system to “remotely”detect when a program has been modified (e.g., for “cheating”).

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is intended neither to identify key featuresor essential features of the claimed subject matter, nor to be used tolimit the scope of the claimed subject matter; rather, this Summary isintended to provide an overview of the subject matter described in thisdocument. Accordingly, it will be appreciated that the above-describedfeatures are merely examples, and that other features, aspects, andadvantages of the subject matter described herein will become apparentfrom the following Detailed Description, Figures, and Claims.

In the following description, for purposes of explanation andnon-limitation, specific details are set forth, such as particularnodes, functional entities, techniques, protocols, etc. in order toprovide an understanding of the described technology. It will beapparent to one skilled in the art that other embodiments may bepracticed apart from the specific details described below. In otherinstances, detailed descriptions of well-known methods, devices,techniques, etc. are omitted so as not to obscure the description withunnecessary detail.

Sections are used in this Detailed Description solely in order to orientthe reader as to the general subject matter of each section; as will beseen below, the description of many features spans multiple sections,and headings should not be read as affecting the meaning of thedescription included in any section.

Example System for Identifying Modified Program Data

FIG. 1 shows a non-limiting example of a system 1 including one or moregame apparatuses 10A-n communicating with server system(s) 20 over anetwork 30. As a non-limiting example, game apparatus 10A-n can playvarious games over network 30 to participate in a multi-player gamingenvironment. Each game apparatus 10A-n could constitute a portable gamedevice, a stationary game console, and/or a hybrid machine usable inboth a stationary and portable configuration. The examples are of coursenon-limiting and the system may use any type of information processingapparatus to constitute game apparatus 10A-n.

It should be appreciated that the network 30 could comprise a network ofinterconnected computing devices, such as the Internet. The network 30could also comprise a local area network (LAN) or could comprise apeer-to-peer connection between the different devices in the system 1.

The server system(s) 20 could comprise any variety of server devicesincluding, but not limited to, database servers, file servers, webservers, application servers, a server cluster (e.g., a cloud-basedcomputing environment), a standalone server, and/or any other portableor stationary computing device having server-based capabilities. Itshould be appreciated that the server system(s) 20 can be implementedusing separately located hardware (e.g., remote hardware) or can beimplemented using a same piece of hardware (e.g., within a single housedserver device).

As a non-limiting example, user(s) may execute a certain game using gameapparatus 10A-n and then play the game in a multiplayer game mode. Insuch a mode, the user(s) may initiate a remote connection with serversystem(s) 20 and enter into a game lobby to set up a multiplayer gamingenvironment among a plurality of users. In the lobby of the multiplayergaming environment, at least one user may customize the multiplayergaming environment by selecting a game mode type, a game map, and/orgame characteristics (e.g., number and difficulty of game bots, weapontypes, shield types), among other aspects.

As the user plays in the multiplayer gaming environment, the user mayperform certain actions to benefit themselves and/or perform certainactions that are used to defeat other users. As a non-limiting example,users may play a multiplayer first person shooter game where the usermay attempt to “shoot” other enemy characters. These users could play asindividuals where every other user is an “enemy,” or they could play onteams where certain characters may be “ally” characters while othercharacters may be “enemy” characters.

FIGS. 2A and 2B show non-limiting example user interfaces 100 of a gamethat can be played by one or more users operating game apparatuses10A-n. In one non-limiting example, FIGS. 2A and 2B shows a first personshooter game where the user can maneuver in a virtual space from a“first person” perspective. While playing the game, the user may move atargeting reticle 101 to aim within the virtual space.

As a non-limiting example, and as shown in FIG. 2A, the user may seedifferent enemy objects 102A and 102B in which the user can aim thetargeting reticle 101. The user interface 100 may also show differentally characters 103A and 103B in which the user may avoid aiming andshooting at in the virtual space. In certain non-limiting example games,the user may be restricted from shooting at and/or damaging allycharacters 103A and 103B under “friendly fire” restrictive techniques.

FIG. 2B shows a non-limiting example of a point in the game where userhas aimed at enemy object 102B. In the example shown in FIG. 2B, theuser has positioned targeting reticle 101 so that enemy object 102B isnow in the user “sights” and thus the user can shoot at and hit enemyobject 102B. In doing so, the user may damage (or destroy) enemy object102B while obtaining “points” for taking such action.

At the conclusion of the game, the users may be ranked based on certaincriteria (e.g., highest point total, number of “kills”). The leaderboardof different players may be displayed at the end of the gameplay showingwhere the specific user “placed” among the other users. Likewise, thesystem could report the in-game performance to server system(s) 20 wherethe user may be ranked among a larger population of users. Likewise,server system(s) 20 may reward the user for their particular performanceby, for example, providing virtual currency to the user and/or unlockingcertain game features, among other aspects.

In the example shown in FIG. 2B, the user may employ a modification tothe program running on their specific game apparatus and thus the usermay be able to “cheat” in the multiplayer game environment. For example,the user may have modified the game program to execute an “auto-aim”cheat allowing the user to easily and automatically aim at enemy object102B. In doing so, the user can very easily target different enemyobjects (102A/B) and more quickly obtain a higher score (therebypotentially unlocking more game benefits). The technology describedherein, in one non-limiting example, allows for detection ofmodification of different game programs.

FIGS. 3-6B depict various aspects of the technology in which the systemcan detect modification of programs running at a client-side device(e.g., game apparatus 10A-n). FIG. 3 specifically shows a non-limitingexample server system 20 for generating and maintaining differentattestation programs. The example server system 20 may use a tool toautomatically create different attestation programs associated withindividual games to determine if a user may have modified the programrunning on the user's terminal.

As a non-limiting example, server system 20 may include a game codelibrary 21 that contains game code for different games. For example, thegame code library 21 may contain game code for the first person shootergame shown in FIGS. 2A and 2B. The game code library 21 could, ofcourse, contain code for hundreds (or thousands) of different games inwhich server system 20 can utilize such game code in building theattestation program. It should be appreciated that the game code may beoriginal source code of a game, or the game code could include programbinary of a game. Of course, the example described in this applicationrelates to game code but is not limited herein. In other words, thetechnology envisions carrying out the novel techniques described in thisapplication in association with any software program including, but notlimited to, system software, application software, freeware, shareware,open-source, and/or cloud based software, among other types.

Server system 20 may also include an attestation program builder 22 thatcan build one or more attestation programs associated with differentgame programs/software titles. In one non-limiting example, attestationprogram builder 22 may use the game code from game code library 21 toanalyze the code for generating different attestation programs. Theseattestation programs could generate different results that correspond totechniques associated with modifying the game/software program at theclient-side device.

Server system 20 may also include networking module(s) 23 for performinga networking function of server system 20. For example, the networkingmodule(s) 23 can implement transmission control protocol (TCP) and/oruser datagram protocol (UDP) for communicating across network 30. Theseexamples are of course non-limiting and networking module(s) 23 canperform any variety of communication using different protocolsincluding, but not limited to, hypertext transfer protocol (HTTP), filetransfer protocol (FTP), Internet Protocol (IP), and the like.

It should be appreciated that server system 20 may use networkingmodule(s) 23 to communicate with different game apparatuses 10A-n. Inone non-limiting example, different server system(s) 20 may usenetworking module(s) 23 to execute a multiplayer gaming environmentbetween different apparatuses 10A-n. As another non-limiting example,server system(s) 20 may use networking module(s) 23 to interact withapparatuses 10A-n in order to implement attestation logic to determinewhether software has been modified on each apparatus 10A-n. Theseexamples are of course non-limiting and the technology described hereinenvisions any variety of methods in which server system(s) 20 maycommunicate with different game apparatuses 10A-n.

As mentioned herein, the system(s) 20 may generate different attestationprograms associated with a particular game (e.g., using attestationprogram builder 22). Once each attestation program is generated, theprogram may be stored in an attestation program database 24 of thesystem 20. In one non-limiting example, attestation program database 24may be or include one or more of: a relational database managementsystem (RDBMS); an object-oriented database management system (OODBMS);an object-relational database management system (ORDBMS); a not-onlystructured query language (NoSQL) data store; an object cache; adistributed file system; a data cluster (based on technology such asHadoop); and/or any other appropriate type of data storage system).

Server system(s) 20 may also include attestation detection logic 25 fordetermining whether a program has been modified by a client-side device(e.g., game apparatus 10A). As a non-limiting example, attestationdetection logic 25 may interface with a game apparatus 10A-n and use oneor more attestation programs stored in attestation program database 24.Attestation detection logic 25 could compare results generated from theclient-side device to the results stored in attestation program database24 to determine if a particular modification (e.g., auto-aim cheat) hasbeen performed on the client-side device 24.

Server system(s) 20 could further include attestation resolution logic26 for determining an appropriate resolution based on the detection ofattestation detection logic 25. As a non-limiting example, upondetermining that the client-side device has modified a particularprogram (e.g., using attestation detection logic 25), attestationresolution logic 26 may execute a procedure to “resolve” the detection.For example, attestation resolution logic 26 may “flag” the client-sidedevice to indicate that the user operating the device has been“cheating.”

The attestation resolution logic 26 could perform certaincorrective/disciplinary action such as locking (or banning) the useraccount, warning the user of the detected “cheating,” or correcting theclient-side device to remove the “cheat” (e.g., using a software“patch”). Likewise, attestation resolution logic 26 may not perform anyaction and may just simply “flag” the user (or client-side device)noting the “cheating” with the possibility of taking certain action at alater date.

It should be appreciated that the components shown in FIG. 3 can beimplemented within a single system. The components could also beincorporated in multiple systems and/or a distributed computingenvironment (e.g., a cloud computing environment). Thus, the system isnot limited to a single component and can be incorporated into multiplecomponents.

FIG. 4 shows a specific non-limiting example embodiment of theattestation program builder 22 building one or more attestation programsusing code from game code library 21. In the example shown in FIG. 4,the builder 22 can build a specification attestation program 22A usinggame code 21A stored in game code library 21.

In the example shown in FIG. 4, game code 21A may contain different codesequences 1-n. As a non-limiting example, these different code sequencescould include a collection of different instructions in a particularprogram language, or could include a combination of differentprogramming “blocks” that include pointers to different memory locationsas well as “calls” to different functions.

In the example shown in FIG. 4, game code 21A may include code sequences1-n to execute a game cycle for a particular game. For example, codesequences 1-n may perform functions that include accepting andprocessing user input, executing game logic based on the input,executing artificial intelligence logic, and/or updating the outputsound and display of the game.

The attestation program builder 22 may automatically re-arrange theexecution order of code sequences 1-n to generate any number ofattestation algorithms of different variety (e.g., memory checks,hashing). Each code sequence may perform a specific operation (e.g.,load from memory, math operation, call to hash function). Theattestation program builder 22 may automatically generate attestationprograms, corresponding to attestation algorithms, by listing referencesto usable code sequences in the game binary in the order they are usedby the attestation algorithm

The final attestation result (e.g., attestation program 22A) may dependon both the value at the test location in a game's “memory” and theoperation performed by each code sequence. For example, code sequence n(shown in attestation program 22A) may use multiplication by a constantvalue, or an addition with a constant value to transform a value readfrom memory. As a non-limiting example, code sequence 2 in program 22Amay read a value from memory at a specific location (e.g., location totest), while the next code sequence n could transform the value throughsome type of operation (e.g., add a constant, perform logicaloperation). The following code sequence 1 could perform a memory hashoperation while the next code sequence 3 could combine the result of thehash operation with a transformed value from the memory read. The finaloutput for attestation program 22A would produce a result that can bestored and later compared to a result from a client-side device todetermine whether modification of a client-side program has occurred.

As another example, a “final” attestation program for testing amodification at a memory location A may be built out of four codesequences. These sequences could include (1) read value from memorylocation A and place the read value in register R, (2) multiply value inregister R by a constant1 and store result in register R, (3) addconstant2 to register R and store result in register R, and/or (4)return result in register R to the server system(s) 20. If, in anotherprogram, the execution order of sequences (2) and (3) is swapped (orinstead of using sequence (2) and (3), sequence (2) is used twice in arow), the result of the attestation program sent to server system(s) 20will change. The result is still dependent on the value at memorylocation A, but the result is also dependent on the execution order ofthe sequences and operation performed by each sequence. It should beappreciated that the value at memory location A could produce a “goldenvalue” stored at server system(s) 20. If a user attempts to modify theresult at memory location A (e.g., to achieve a desired game cheat), theresult of the attestation program run in association with memorylocation A will differ from that stored in server system(s) 20 thusnotifying system(s) 20 that a modification has occurred in the game.

It should be appreciated that server system(s) 20 could maintain adatabase (e.g., in database 24) of results per each attestation program.With the stored results, the server system(s) 20 could compare resultsproduced from the client-side devices (e.g., game apparatus 10A-n) todetermine whether a modification has been detected.

It should be appreciated that, to fake a result of an attestationprogram, an “attacker” would need to analyze the program, extract codesequences and their order, and analyze what each code sequence does. Asthere are numerous amounts of usable code sequences in a typical game,this process is extremely difficult to implement in real-time. Thus, thesystem 1 described herein advantageously allows for “remote” detectionof cheating.

FIG. 5 shows a non-limiting example of an attestation program database24 storing different results for different attestation programsassociated with various games. In one non-limiting example, the database24 can store each of the attestation programs generated by attestationprogram builder 22 in which attestation detection logic 25 can accessfor determining if software modification has occurred at a client-sidedevice.

In the example shown in FIG. 5, attestation program database 24 containsdifferent attestation programs for games 1-X. The games 1-X couldinclude any type of video game including, but not limited to, shootervideo games (e.g., first person shooter, third person shooter), actionvideo games, adventure video games, sports video games, puzzle videogames, and/or dance video games.

As a non-limiting example, and as discussed herein, attestation programbuilder 22 can scan code from games in game code library 21 to generatedifferent attestation programs associated with each game. Theattestation programs will produce a specific result that can be comparedto a game running on a client-side terminal in order to determine if theclient-side program has been modified.

In the example shown in FIG. 5, attestation program database 24 includesgames 1-X. Each of games 1-X contain their own associated attestationprograms. For example, game 1 could be directed to a first personshooter game where the first person shooter game has attestationprograms AP1-n generated for the game. Each of these attestationprograms AP1-n will produce respective attestation results AR1-n.

It should be appreciated that each of games 2-X have their associatedattestation programs AP1-n for each game, with each program AP1-nproducing respective attestation results AR1-n. As discussed herein, thesystem 1 can perform an “attestation check” against a program running ona client-side device and compare it to one or more of the results AR1-nstored in database 24. For example, an “attestation check” can be runagainst game apparatus 10A for game 1 where the “attestation check” canproduce a result from game apparatus 10A.

As a specific example, server system(s) 20 may send an attestationprogram to game apparatus 10A. The attestation program could includereferences to code sequences that are transmitted to game apparatus 10A.It should be appreciated that each program stored/running on gameapparatus 10A-n may have an associated thin library that understands anattestation request received by an apparatus 10A-n from server system(s)20. The attestation request (e.g., attestation program) will cause anapparatus 10A to generate an attestation result which will then be sentback to server system(s) 20.

In more detail, this result from game apparatus 10A can be communicatedto server system(s) 20 (e.g., using networking module(s) 23)) whereserver system(s) 20 can compare the result to one stored in database 24.For example, an “attestation check” may be performed against gameapparatus 10A playing game 1 to detect a specific “auto-aim” cheatfeature. The “auto-aim” cheat feature could correspond to one generatedby attestation program AP1 having a corresponding attestation resultAR1. It should be appreciated that one target may be detection ofbroadly distributed exploits (e.g., cheats). For example, the desiredexploits may be of a type that any user possessing no technicalknowledge can install on their system (such exploits can be found onweb-sites such as “maxcheats.com”). The technology described herein cancompute attestation results for games with such specific modificationand store such results together with the programs. Thus, eachattestation program stored on server system(s) 20 will have (1) anexpected “golden result”, (2) one or more exploits and theircorresponding “bad” results, and/or (3) certain “unknown” results wherethe exploit may not yet have been identified.

The system(s) 20 can run a query of the result produced by gameapparatus 10A playing game 1 against database 24 to determine if aparticular result matches one stored in database 24. The system(s) 20could perform such a query using a standard database query language(e.g., SQL). In doing so, the system(s) 20 can detect if a certainmodification have been made by apparatus 10A in association with thisparticular feature (e.g., “auto-aim” cheat) for game 1 and, upondetection, system(s) 20 can then take some type of administrativeaction.

These examples are of course non-limiting and the system envisions anyvariety of method for storing and comparing attestation results toresults produced from different “attestation checks” on client-sidedevices. Moreover, a certain “cheat” may be detected from a number ofdifferent attestation programs and thus one “cheat” is not limited toonly one attestation program. Put another way, a specific cheat for agame may be reproduced using a number of attestation programs (eachhaving different attestation results).

FIGS. 6A and 6B show non-limiting example flowcharts 600 for processescarried out by system 1. FIG. 6A specifically shows a flowchart 600 fora non-limiting process of generating one or more attestation programs(e.g., using attestation program builder 22. FIG. 6B specifically showsa flowchart 600 for a non-limiting process of detecting a modificationand carrying out “corrective” action (e.g., using attestation detectionlogic 25 and/or attestation resolution logic 26). It should beappreciated that the processes shown in FIGS. 6A and 6B can be carriedout by system 1 (e.g., using server system(s) 20). Of course, thisexample is non-limiting and the processes shown in FIGS. 6A and 6B canbe executed under a variety of different methods.

The process begins with system 1 obtaining program code (e.g., from gamecode library 21) for a given program (action S1). For example, system 1may obtain program code for game 1 related to a first person shootergame. The game code could contain thousands (or hundreds of thousands)of code sequences nested within various functions of the game software.Each of these functions may call other functions or include pointers todifferent areas of memory for performing a specific task. As mentionedherein, it should be appreciated that the program could include sourcecode of the program, or could include program binary.

At action S2, the system 1 can scan the program code (e.g., scan programbinary using attestation program builder 22) for usable code sequences.As a non-limiting example, the program code may contain certain codesequences that, by themselves, are not related to any attestationpurpose. But, certain code sequences can be combined to produce adesired attestation algorithm

At action S3, the system 1 can combine these code sequences to generatean attestation algorithm producing a specific result. As discussedherein, the original game code may include an intended executionsequences (i.e., implementing game logic). The system 1 can combine fromthese sequences to “strategically” achieve a desired functionality. Inone example, the desired functionality may include checking memorylocations for modifications and/or performing hash checking of memory.

At action S4, the system 1 uses these combined code sequences togenerate an attestation program. As a non-limiting example, system 1could use a collection of combined code sequences to generateattestation programs for detecting a specific “cheat” in a particulargame (e.g., auto-aim, walk through walls, level-up player characters).

The result of the attestation program may be maintained in a database(e.g., attestation program database 24) of the system (at action S5). Inone non-limiting example, the attestation result can be associated witheach attestation program for a particular game. These pairings can beseen, for example, in FIG. 5 described herein.

FIG. 6B thus shows a non-limiting example flowchart 600 for performingan “attestation check” against one or more client-side devices. Theprocess begins at action S6 where the system 1 can detect certainprograms running on a client-side device. As a non-limiting example,server system(s) 20 may detect that game apparatus 10A is executing game1 in a multiplayer game environment.

At action S7, the system 1 can perform an “attestation check” againstthe client-side device. For example, server system(s) 20 can communicatewith game apparatus 10A using networking module(s) 23 over network 30.Server system(s) 20 can perform an “attestation check” of game 1 runningon game apparatus 10A to produce one or more attestation results. In onenon-limiting example, system(s) 20 may send references to certain codesequences to a game apparatus 10A. Game apparatus 10A may utilize thethin library associated with a particular game to generate a resultassociated with the references to the code sequences sent from system(s)20. The result can be generated and sent from game apparatus 10A toserver system(s) 20.

At action S8, the system 1 can compare the attestation result producedby the client-side device to those stored in the database memory of thesystem 20 (e.g., attestation program database 24). As a non-limitingexample, and as discussed herein, the client-side device could producean attestation result corresponding to a particular game cheat. Thisresult can be queried against database 24 for the particular game. Itshould be appreciated that the database may include a “good” resultcorresponding to the software functioning properly on the client-sidedevice. The database 24 may also include a “bad” result corresponding toa known cheat. Likewise, database 24 may also store an “unknown” resultthat does not match the known “good” result but also does not match anyknown “bad” results (e.g., cheats).

If a match is found (action S9), the system can flag the client-sidedevice and/or take certain corrective action (action S10). In thesituations where the result does not match a “good” result or a “bad”result, it is possible that the client-side device did not make anymodification, but there is a hardware malfunction, or the client-sidedevice made a modification that did not match a result in database 24.Likewise, if the client-side device returns a “good” result, then theprocess may end as the software may not have been modified by theclient-side device.

It should be appreciated that, based on whether a match is detected, thesystem 1 can determine how to most appropriately proceed. That is, ifthe result returned by the client-side device matches a known “bad”result, or if the result returned matches an “unknown” result (or doesnot match any value stored in database 24), system 1 may flag theclient-side device as having modified a particular program (e.g., forcheating purposes). System 1 may also determine some type ofadministrative/corrective action to carry out against client-sidedevice. For example, system 1 may only send a warning to the client-sidedevice (e.g., using email or messaging service(s)) notifying the userthat the particular modification has been detected. System 1 may alsoperform certain disciplinary actions such as locking the game (or userterminal) and/or temporarily or permanently banning the user.

It should be appreciated that in some instances, the result output fromclient-side device may not match a stored “good” or “bad” result andthus there may not be enough evidence to determine if any modificationoccurred. Thus, system 1 may also decide to take no corrective actionagainst the client side device. For example, system 1 may determine thatthe particular result obtained by client side device could have beengenerated by accident or through some type of “glitch” on the clientside device. In this case, system 1 may neither flag the client-sidedevice nor take any corrective/administrative action against the device.Likewise, system 1 may determine that the device should be flagged butthat no other corrective action should be taken.

In certain example embodiments, system 1 may flag these devices andmaintain a list of devices flagged that produce similar results. If moredevices begin returning similar results to that of the flagged device,it may be indicative of a new cheat in which system 1 does not have acorresponding attestation program for detecting such a cheat. After aperiod of time, the result may be determined as corresponding to aparticular type of cheat and thus the corrective action could be takenat that point against client-side devices producing the previously“unknown” result. These examples are of course non-limiting and thesystem envisions any variety of actions that could be carried out uponfinding an “attestation match.”

It should be understood that, although actions S1 through action S5 andaction S6-S10 are described above as separate actions with a givenorder, this is done for ease of description. It should be understoodthat, in various embodiments, the above-mentioned actions may beperformed in various orders; alternatively or additionally, portions ofthe above-described actions (action S1 through action S10) may beinterleaved and/or performed concurrently with portions of the otheractions (action S1 through action S10).

FIG. 7 shows a non-limiting example block diagram of a hardwarearchitecture for the system 1260. In the example shown in FIG. 7, theclient device 1210 communicates with a server system 1200 via a network1240. The network 1240 could comprise a network of interconnectedcomputing devices, such as the internet. The network 1240 could alsocomprise a local area network (LAN) or could comprise a peer-to-peerconnection between the client device 1210 and the server system 1200. Aswill be described below, the hardware elements shown in FIG. 7 could beused to implement the various software components and actions shown anddescribed above as being included in and/or executed at the clientdevice 1210 and server system 1200.

In some embodiments, the client device 1210 (which may also be referredto as “client system” herein) includes one or more of the following: oneor more processors 1212; one or more memory devices 1214; one or morenetwork interface devices 1216; one or more display interfaces 1218; andone or more user input adapters 1220. Additionally, in some embodiments,the client device 1210 is connected to or includes a display device1222. As will explained below, these elements (e.g., the processors1212, memory devices 1214, network interface devices 1216, displayinterfaces 1218, user input adapters 1220, display device 1222) arehardware devices (for example, electronic circuits or combinations ofcircuits) that are configured to perform various different functions forthe computing device 1210.

In some embodiments, each or any of the processors 1212 is or includes,for example, a single- or multi-core processor, a microprocessor (e.g.,which may be referred to as a central processing unit or CPU), a digitalsignal processor (DSP), a microprocessor in association with a DSP core,an Application Specific Integrated Circuit (ASIC), a Field ProgrammableGate Array (FPGA) circuit, or a system-on-a-chip (SOC) (e.g., anintegrated circuit that includes a CPU and other hardware componentssuch as memory, networking interfaces, and the like). And/or, in someembodiments, each or any of the processors 1212 uses an instruction setarchitecture such as x86 or Advanced RISC Machine (ARM).

In some embodiments, each or any of the memory devices 1214 is orincludes a random access memory (RAM) (such as a Dynamic RAM (DRAM) orStatic RAM (SRAM)), a flash memory (based on, e.g., NAND or NORtechnology), a hard disk, a magneto-optical medium, an optical medium,cache memory, a register (e.g., that holds instructions), or other typeof device that performs the volatile or non-volatile storage of dataand/or instructions (e.g., software that is executed on or by processors1212). Memory devices 1214 are examples of non-volatilecomputer-readable storage media.

In some embodiments, each or any of the network interface devices 1216includes one or more circuits (such as a baseband processor and/or awired or wireless transceiver), and implements layer one, layer two,and/or higher layers for one or more wired communications technologies(such as Ethernet (IEEE 802.3)) and/or wireless communicationstechnologies (such as Bluetooth, WiFi (IEEE 802.11), GSM, CDMA2000,UMTS, LTE, LTE-Advanced (LTE-A), and/or other short-range, mid-range,and/or long-range wireless communications technologies). Transceiversmay comprise circuitry for a transmitter and a receiver. The transmitterand receiver may share a common housing and may share some or all of thecircuitry in the housing to perform transmission and reception. In someembodiments, the transmitter and receiver of a transceiver may not shareany common circuitry and/or may be in the same or separate housings.

In some embodiments, each or any of the display interfaces 1218 is orincludes one or more circuits that receive data from the processors1212, generate (e.g., via a discrete GPU, an integrated GPU, a CPUexecuting graphical processing, or the like) corresponding image databased on the received data, and/or output (e.g., a High-DefinitionMultimedia Interface (HDMI), a DisplayPort Interface, a Video GraphicsArray (VGA) interface, a Digital Video Interface (DVI), or the like),the generated image data to the display device 1222, which displays theimage data. Alternatively or additionally, in some embodiments, each orany of the display interfaces 1218 is or includes, for example, a videocard, video adapter, or graphics processing unit (GPU).

In some embodiments, each or any of the user input adapters 1220 is orincludes one or more circuits that receive and process user input datafrom one or more user input devices (not shown in FIG. 7) that areincluded in, attached to, or otherwise in communication with the clientdevice 1210, and that output data based on the received input data tothe processors 1212. Alternatively or additionally, in some embodimentseach or any of the user input adapters 1220 is or includes, for example,a PS/2 interface, a USB interface, a touchscreen controller, or thelike; and/or the user input adapters 1220 facilitates input from userinput devices (not shown in FIG. 7) such as, for example, a keyboard,mouse, trackpad, touchscreen, etc. . . .

In some embodiments, the display device 1222 may be a Liquid CrystalDisplay (LCD) display, Light Emitting Diode (LED) display, or other typeof display device. In embodiments where the display device 1222 is acomponent of the client device 1210 (e.g., the computing device and thedisplay device are included in a unified housing), the display device1222 may be a touchscreen display or non-touchscreen display. Inembodiments where the display device 1222 is connected to the clientdevice 1210 (e.g., is external to the client device 1210 andcommunicates with the client device 1210 via a wire and/or via wirelesscommunication technology), the display device 1222 is, for example, anexternal monitor, projector, television, display screen, etc. . . .

In various embodiments, the client device 1210 includes one, or two, orthree, four, or more of each or any of the above-mentioned elements(e.g., the processors 1212, memory devices 1214, network interfacedevices 1216, display interfaces 1218, and user input adapters 1220).Alternatively or additionally, in some embodiments, the client device1210 includes one or more of: a processing system that includes theprocessors 1212; a memory or storage system that includes the memorydevices 1214; and a network interface system that includes the networkinterface devices 1216.

The client device 1210 may be arranged, in various embodiments, in manydifferent ways. As just one example, the client device 1210 may bearranged such that the processors 1212 include: a multi (or single)-coreprocessor; a first network interface device (which implements, forexample, WiFi, Bluetooth, NFC, etc. . . . ); a second network interfacedevice that implements one or more cellular communication technologies(e.g., 3G, 4G LTE, CDMA, etc. . . . ); memory or storage devices (e.g.,RAM, flash memory, or a hard disk). The processor, the first networkinterface device, the second network interface device, and the memorydevices may be integrated as part of the same SOC (e.g., one integratedcircuit chip). As another example, the client device 1210 may bearranged such that: the processors 1212 include two, three, four, five,or more multi-core processors; the network interface devices 1216include a first network interface device that implements Ethernet and asecond network interface device that implements WiFi and/or Bluetooth;and the memory devices 1214 include a RAM and a flash memory or harddisk.

Server system 1200 also comprises various hardware components used toimplement the software elements for server system(s) 20. In someembodiments, the server system 1200 (which may also be referred to as“server device” herein) includes one or more of the following: one ormore processors 1202; one or more memory devices 1204; and one or morenetwork interface devices 1206. As will explained below, these elements(e.g., the processors 1202, memory devices 1204, network interfacedevices 1206) are hardware devices (for example, electronic circuits orcombinations of circuits) that are configured to perform variousdifferent functions for the server system 1200.

In some embodiments, each or any of the processors 1202 is or includes,for example, a single- or multi-core processor, a microprocessor (e.g.,which may be referred to as a central processing unit or CPU), a digitalsignal processor (DSP), a microprocessor in association with a DSP core,an Application Specific Integrated Circuit (ASIC), a Field ProgrammableGate Array (FPGA) circuit, or a system-on-a-chip (SOC) (e.g., anintegrated circuit that includes a CPU and other hardware componentssuch as memory, networking interfaces, and the like). And/or, in someembodiments, each or any of the processors 1202 uses an instruction setarchitecture such as x86 or Advanced RISC Machine (ARM).

In some embodiments, each or any of the memory devices 1204 is orincludes a random access memory (RAM) (such as a Dynamic RAM (DRAM) orStatic RAM (SRAM)), a flash memory (based on, e.g., NAND or NORtechnology), a hard disk, a magneto-optical medium, an optical medium,cache memory, a register (e.g., that holds instructions), or other typeof device that performs the volatile or non-volatile storage of dataand/or instructions (e.g., software that is executed on or by processors1202). Memory devices 1204 are examples of non-volatilecomputer-readable storage media.

In some embodiments, each or any of the network interface devices 1206includes one or more circuits (such as a baseband processor and/or awired or wireless transceiver), and implements layer one, layer two,and/or higher layers for one or more wired communications technologies(such as Ethernet (IEEE 802.3)) and/or wireless communicationstechnologies (such as Bluetooth, WiFi (IEEE 802.11), GSM, CDMA2000,UMTS, LTE, LTE-Advanced (LTE-A), and/or other short-range, mid-range,and/or long-range wireless communications technologies). Transceiversmay comprise circuitry for a transmitter and a receiver. The transmitterand receiver may share a common housing and may share some or all of thecircuitry in the housing to perform transmission and reception. In someembodiments, the transmitter and receiver of a transceiver may not shareany common circuitry and/or may be in the same or separate housings.

In various embodiments, the server system 1200 includes one, or two, orthree, four, or more of each or any of the above-mentioned elements(e.g., the processors 1202, memory devices 1204, network interfacedevices 1206). Alternatively or additionally, in some embodiments, theserver system 1200 includes one or more of: a processing system thatincludes the processors 1202; a memory or storage system that includesthe memory devices 1204; and a network interface system that includesthe network interface devices 1206.

The server system 1200 may be arranged, in various embodiments, in manydifferent ways. As just one example, the server system 1200 may bearranged such that the processors 1202 include: a multi (or single)-coreprocessor; a first network interface device (which implements, forexample, WiFi, Bluetooth, NFC, etc. . . . ); a second network interfacedevice that implements one or more cellular communication technologies(e.g., 3G, 4G LTE, CDMA, etc. . . . ); memory or storage devices (e.g.,RAM, flash memory, or a hard disk). The processor, the first networkinterface device, the second network interface device, and the memorydevices may be integrated as part of the same SOC (e.g., one integratedcircuit chip). As another example, the server system 1200 may bearranged such that: the processors 1202 include two, three, four, five,or more multi-core processors; the network interface devices 1206include a first network interface device that implements Ethernet and asecond network interface device that implements WiFi and/or Bluetooth;and the memory devices 1204 include a RAM and a flash memory or harddisk.

As previously noted, whenever it is described in this document that asoftware module or software process performs any action, the action isin actuality performed by underlying hardware elements according to theinstructions that comprise the software module. Consistent with theforegoing, in various embodiments, each or any combination of the clientdevice 1210 or the server system 1200, each of which will be referred toindividually for clarity as a “component” for the remainder of thisparagraph, are implemented using an example of the client device 1210 orthe server system 1200 of FIG. 7.

In such embodiments, the following applies for each component: (a) theelements of the client device 1210 shown in FIG. 7 (i.e., the one ormore processors 1212, one or more memory devices 1214, one or morenetwork interface devices 1216, one or more display interfaces 1218, andone or more user input adapters 1220) and the elements of the serversystem 1200 (i.e., the one or more processors 1202, one or more memorydevices 1204, one or more network interface devices 1206), orappropriate combinations or subsets of the foregoing, are configured to,adapted to, and/or programmed to implement each or any combination ofthe actions, activities, or features described herein as performed bythe component and/or by any software modules described herein asincluded within the component; (b) alternatively or additionally, to theextent it is described herein that one or more software modules existwithin the component, in some embodiments, such software modules (aswell as any data described herein as handled and/or used by the softwaremodules) are stored in the respective memory devices (e.g., in variousembodiments, in a volatile memory device such as a RAM or an instructionregister and/or in a non-volatile memory device such as a flash memoryor hard disk) and all actions described herein as performed by thesoftware modules are performed by the respective processors inconjunction with, as appropriate, the other elements in and/or connectedto the client device 1210 or server system 1200; (c) alternatively oradditionally, to the extent it is described herein that the componentprocesses and/or otherwise handles data, in some embodiments, such datais stored in the respective memory devices (e.g., in some embodiments,in a volatile memory device such as a RAM and/or in a non-volatilememory device such as a flash memory or hard disk) and/or isprocessed/handled by the respective processors in conjunction, asappropriate, the other elements in and/or connected to the client device1210 or server system 1200; (d) alternatively or additionally, in someembodiments, the respective memory devices store instructions that, whenexecuted by the respective processors, cause the processors to perform,in conjunction with, as appropriate, the other elements in and/orconnected to the client device 1210 or server system 1200, each or anycombination of actions described herein as performed by the componentand/or by any software modules described herein as included within thecomponent.

The hardware configurations shown in FIG. 7 and described above areprovided as examples, and the subject matter described herein may beutilized in conjunction with a variety of different hardwarearchitectures and elements. For example: in many of the Figures in thisdocument, individual functional/action blocks are shown; in variousembodiments, the functions of those blocks may be implemented using (a)individual hardware circuits, (b) using an application specificintegrated circuit (ASIC) specifically configured to perform thedescribed functions/actions, (c) using one or more digital signalprocessors (DSPs) specifically configured to perform the describedfunctions/actions, (d) using the hardware configuration described abovewith reference to FIG. 7, (e) via other hardware arrangements,architectures, and configurations, and/or via combinations of thetechnology described in (a) through (e).

In many places in this document, software modules and actions performedby software modules are described. This is done for ease of description;it should be understood that, whenever it is described in this documentthat a software module performs any action, the action is in actualityperformed by underlying hardware components (such as a processor and amemory) according to the instructions and data that comprise thesoftware module.

Technical Advantages

The technology described herein provides improvements to existingtechnology for determining whether a user has modified a program runningon the user device. In particular, the technology allows for automaticcreation of different attestation programs that can be stored on aremote-side device (e.g., a server system) and then the remote-sidedevice can run “attestation checks” against programs running ondifferent client devices. By comparing results produced from the clientdevices during the “attestation checks,” the remote-side device candetermine if the client device has modified the particular program.

The technology herein thus allows for the remote-side device toautomatically generate attestation programs for remotely detectingwhether different client-side devices have modified programs on theclient-side devices. Such an approach advantageously enables theremote-side device to perform “attestation checks” without requiring theattestation logic on the client-side device. In doing so, the technologyprevents the client side device from being able to modify theattestation logic thus requiring the remote-side device to fix suchmodifications through widely deployed software patches. The technologythus improves the overall security of the system as well as thehuman-user interface experience. Moreover, by reducing the need fordeploying various software patches, the system reduces the amount ofcommunication between components in the system thus improving theoverall communication bandwidth of the system.

Selected Definitions

Whenever it is described in this document that a given item is presentin “some embodiments,” “various embodiments,” “certain embodiments,”“certain example embodiments, “some example embodiments,” “an exemplaryembodiment,” or whenever any other similar language is used, it shouldbe understood that the given item is present in at least one embodiment,though is not necessarily present in all embodiments. Consistent withthe foregoing, whenever it is described in this document that an action“may,” “can,” or “could” be performed, that a feature, element, orcomponent “may,” “can,” or “could” be included in or is applicable to agiven context, that a given item “may,” “can,” or “could” possess agiven attribute, or whenever any similar phrase involving the term“may,” “can,” or “could” is used, it should be understood that the givenaction, feature, element, component, attribute, etc. is present in atleast one embodiment, though is not necessarily present in allembodiments. Terms and phrases used in this document, and variationsthereof, unless otherwise expressly stated, should be construed asopen-ended rather than limiting. As examples of the foregoing: “and/or”includes any and all combinations of one or more of the associatedlisted items (e.g., a and/or b means a, b, or a and b); the singularforms “a”, “an” and “the” should be read as meaning “at least one,” “oneor more,” or the like; the term “example” is used provide examples ofthe subject under discussion, not an exhaustive or limiting listthereof; the terms “comprise” and “include” (and other conjugations andother variations thereof) specify the presence of the associated listeditems but do not preclude the presence or addition of one or more otheritems; and if an item is described as “optional,” such descriptionshould not be understood to indicate that other items are also notoptional.

As used herein, the term “non-transitory computer-readable storagemedium” includes a register, a cache memory, a ROM, a semiconductormemory device (such as a D-RAM, S-RAM, or other RAM), a magnetic mediumsuch as a flash memory, a hard disk, a magneto-optical medium, anoptical medium such as a CD-ROM, a DVD, or Blu-Ray Disc, or other typeof device for non-transitory electronic data storage. The term“non-transitory computer-readable storage medium” does not include atransitory, propagating electromagnetic signal.

Further Applications of Described Subject Matter

Although process steps, algorithms or the like, including withoutlimitation with reference to FIGS. 1-7, may be described or claimed in aparticular sequential order, such processes may be configured to work indifferent orders. In other words, any sequence or order of steps thatmay be explicitly described or claimed in this document does notnecessarily indicate a requirement that the steps be performed in thatorder; rather, the steps of processes described herein may be performedin any order possible. Further, some steps may be performedsimultaneously (or in parallel) despite being described or implied asoccurring non-simultaneously (e.g., because one step is described afterthe other step). Moreover, the illustration of a process by itsdepiction in a drawing does not imply that the illustrated process isexclusive of other variations and modifications thereto, does not implythat the illustrated process or any of its steps are necessary, and doesnot imply that the illustrated process is preferred.

Although various embodiments have been shown and described in detail,the claims are not limited to any particular embodiment or example. Noneof the above description should be read as implying that any particularelement, step, range, or function is essential. All structural andfunctional equivalents to the elements of the above-describedembodiments that are known to those of ordinary skill in the art areexpressly incorporated herein by reference and are intended to beencompassed. Moreover, it is not necessary for a device or method toaddress each and every problem sought to be solved by the presentinvention, for it to be encompassed by the invention. No embodiment,feature, element, component, or step in this document is intended to bededicated to the public.

At least the following is claimed:
 1. A system for detectingmodifications to program data, comprising: a processor; and a memoryconfigured to store computer readable instructions that, when executedby the processor, cause the system to: obtain program code for a firstprogram configured for execution on a client device; scan the programcode for the first program for usable code sequences; combine portionsof the usable code sequences to form a first attestation program havinga first attestation result; store the first attestation program havingthe first attestation result into a database in the memory of thesystem; transmit data associated with the first attestation program tothe client device to run an attestation check against the first programexecuting on the client device, the attestation check generating a firstattestation check result; receive the first attestation check resultfrom the client device; compare the first attestation check result tothe first attestation result associated with the first attestationprogram to determine if the first attestation result matches the firstattestation check result; and perform an action associated with theclient device based on the comparison.